NETWORK CONTROLLER AND CONTROL METHOD WITH FLOW ANALYSIS AND CONTROL FUNCTION (As Amended)

ABSTRACT

A network controller, capable of high-speed extraction of malicious traffic from networks and determining characteristics of such traffic, includes a unit for accumulating a number of packets for each arbitrary itemset included in the header portions of packets to be transferred, and a unit for determining whether the accumulated value obtained by the accumulating unit exceeds a predetermined threshold, and determines the types of packets to be transferred from accumulated values of the itemset and an itemset different from the itemset when the number of packets exceed a threshold.

CROSS-REFERENCE

This is a continuation application of U.S. Ser. No. 11/365,609, filedMar. 2, 2006.

INCORPORATION BY REFERENCE

The present application claims priorities from Japanese applicationsJP2005-109744 filed on Apr. 6, 2005 and JP2006-019980 filed on Jan. 30,2006, the contents of which are hereby incorporated by reference intothis application.

BACKGROUND OF THE INVENTION

The present invention relates to a network controller and a networkcontrol system for transferring packets on a network between networks,and more particularly, to a network controller and a network controlsystem capable of effectively detecting inappropriate traffic from largevolumes of traffic, and controlling the transfer of such traffic.

As the use of the Internet or LANs increases, the significance of stablyoperating such networks is increasing accordingly. In particular, theInternet allows an unspecified number of users to use variousapplications. Therefore, occurrences of traffic overloads that exceedthe assumptions of Internet service providers, or traffic caused byfraudulent activities such as attacks or spreading of network worms arehighly likely. Thus, there exists a problem in detecting and controllingsuch traffic in order to secure stability of normal communication.

Intrusion detection systems are known as a typical technique to addressthis problem. An intrusion detection system involves maintaining inadvance patterns of malicious packets as a database, and detectingmalicious packets by comparing received packets with the contents of thedatabase. Since an intrusion detection system compares packets to betested with a huge database of malicious packets, its processing speedcan become an issue. However, methods for speeding up processing, forinstance by narrowing down in advance the contents of databases to becompared against according to the types of servers existing within asecured network have been disclosed (see for instance JP-A-2003-223375).

In addition, as a technique to handle occurrences of excessive trafficthat may trigger network congestion, methods such as determining inadvance targets to be monitored on a per-user or per-computer basis,measuring information such as traffic volume for each monitoring target,and upon occurrence of congestions performing rate limiting on trafficwith high traffic volumes have been disclosed (see for instanceJP-A-2001-217842).

Furthermore, recently traffic analysis methods such as using basketanalysis for high-speed extraction of traffic with predeterminedcharacteristics that occupy wide bands in networks such as Internetbackbone networks through which vast volumes of traffic flow, have beendisclosed (see for instance JP-A-2005-285048). Basket analysis is a datamining method commonly used for analyzing data to determine whichcombinations of products are purchased together in retail stores and thelike.

The technique disclosed in JP-A-2003-223375 attempts to speed upprocessing in an intrusion detection system that relies on patternmatching to detect malicious packets by reducing the patterns to bematched. This may be effective in, for instance, a network of a scalecomparable to an entrance of an organizational network where onlylimited services are used. However, a ceiling exists on processing speedsince pattern matching is performed for each packet, and therefore thetechnique is incapable of handling traffic of a scale comparable toInternet backbone networks.

The technique disclosed in JP-A-2001-217842 attempts to determine inadvance monitoring targets, and manage the volumes of used traffic ofthe monitoring targets with a database. This technique may be sufficientfor use in a limited environment of the monitoring targets. However,when applying it to an Internet backbone network through which anunspecified volume of traffic such as computers flows, it becomesdifficult to determine in advance monitoring targets. Even if thetechnique is applied, it will require vast resources such as memory.

The technique disclosed in JP-A-2005-285048 may overcome the problems ofprocessing ability or required resources such as memory described inJP-A-2003-223375 or JP-A-2001-217842. However, the technique does notconsider acquiring information necessary to accurately determinecharacteristics of extracted traffic (for example DDoS attack, networkworm outbreak, P2P file exchange). Therefore, it is difficult to preventmiscontrol of extracted traffic when attempting to perform prohibitionand other controls on the extracted traffic.

SUMMARY OF THE INVENTION

Therefore, it is an object of the present invention to provide a networkcontroller and a network control system capable of high-speed extractionand characteristic determination of inappropriate traffic even innetworks with vast volumes of traffic such as an Internet backbonenetwork.

It is another object of the present invention to provide a networkcontroller and a network control system capable of extracting networkdevices generating excessive traffic with minimal memory resourceswithout limiting monitoring targets.

It is yet another object of the present invention to provide a networkcontroller and a network control system capable of performing automaticcontrol according to preset control policies against traffic alreadyextracted and their characteristics determined.

In order to achieve the above objects, a network controller includes aunit for accumulating the number of packets for each arbitrary itemsetcontained in the header portion of packets to be transferred, and a unitfor determining whether an accumulated value obtained by theaccumulating unit exceeds a predetermined threshold, wherein the networkcontroller determines the type of packets to be transferred from anaccumulated value of the itemset and another itemset that differs fromthe former itemset when the number of packets exceed the threshold.

The unit for accumulating numbers of packets is provided with anallocating unit that uses hash values of itemsets to allocate regionsfor retaining itemsets and accumulated valuesets, a unit for subtractingthe accumulated value of a region when the allocating unit has allocateda region that is already used for accumulating another itemset, and aunit that enables the latter itemset to overwrite and use the regionwhen the subtraction results in an accumulate value of 0.

The network controller further includes a flow control unit thatcontrols whether or not a particular packet within traffic should betransferred, as well as the band to be used for the transfer, and a unitfor changing the settings of the flow control unit according to theresults of the packet type determination.

Thus, there is provided a network controller including a connection unitfor connecting to one or more networks, a monitoring unit for monitoringpackets flowing through the networks, an accumulating unit foraccumulating the number of packets obtained by the monitor unit whereinthe values of any one or more fieldsets are the same, and a packetestimating unit for estimating the characteristics of a number ofpackets that have exceeded a designated threshold from a value of anyone or more fieldsets that differ from the abovementioned one or morefieldsets when the accumulated number of packets exceed the designatedthreshold.

Other problems, units and advantages will be revealed in the detaileddescription of the examples.

According to the present invention, since malicious packets can beextracted and their characteristics determined without having to performpattern matching of packets, there is an advantage where the presentinvention may also be applied to high-speed networks with large volumes.

In addition, there is an advantage where packets in heavy traffic can beextracted without particularly limiting monitoring target packets, evenwhen only a limited storage area can be used for the detection ofspecific traffic.

Furthermore, since the present invention enables control over detectedspecific traffic according to predesignated rules, countermeasuresagainst malicious traffic such as prohibition and rate limiting may beswiftly imposed even in high-speed networks.

Other objects, features and advantages of the invention will becomeapparent from the following description of the embodiments of theinvention taken in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing an example of a configuration of a networkcontroller according to a first example of a preferred embodiment of thepresent invention;

FIG. 2 is a diagram showing an example of a content of a packet counttable according to the first example;

FIG. 3 is a diagram showing an example of a content of a threshold tableaccording to the first example;

FIG. 4 is a diagram showing an example of a content of a control policytable according to the first example;

FIG. 5 is a flowchart showing an example of an operation of the networkcontroller according to the first example;

FIG. 6 is a diagram showing an example of a content of trafficinformation according to the first example;

FIG. 7 is a flowchart showing an example of the details of trafficinformation analysis according to the first example;

FIG. 8 is a diagram showing an example of a content of overthresholdinformation according to the first example;

FIG. 9 is a flowchart showing an example of the details of updating thepacket count table according to the first example;

FIG. 10 is a flowchart showing an example of the details of determiningproblematic traffic according to the first example;

FIG. 11 is a diagram showing an example of a configuration of a networkcontrol system according to a second example of a preferred embodimentof the present invention;

FIG. 12 is a flowchart showing an example of an operation of the networkcontrol system according to the second example;

FIG. 13 is a diagram showing an example of a content of a packet counttable according to a third example of a preferred embodiment of thepresent invention;

FIG. 14 is a flowchart showing an example of the details of updating thepacket count table according to the third example;

FIG. 15 is a diagram showing an example of a content of a supplementarytable according to the third example; and

FIG. 16 is a flowchart showing an example of the details of determiningproblematic traffic according to the third example.

DESCRIPTION OF THE EMBODIMENTS

A preferred embodiment of the present invention will be described below.However, the present invention is not limited to the describedembodiment.

Examples of a network controller, a network control system and a networkcontrol method will be described with reference to the drawings.

1. First Example

A first example will now be described. FIG. 1 is a configuration diagramof a network controller according to an example of the presentembodiment. In the drawing, reference numeral 101 denotes a networkcontroller according to the present embodiment, reference numeral 102denotes an input/output device for giving instructions to the networkcontroller 101 and enabling it to display status, and reference numerals103, 104 and 105 denote networks connected to the network controller101.

The network controller 101 is composed of a packet transferring section106 and a specific traffic detection and control section 107. Aconnection interface 108 connects the packet transferring section 106and the specific traffic detection and control section 107, and allowsdata exchange between the packet transferring section 106 and thespecific traffic detection and control section 107.

The packet transferring section 106 is composed of a CPU 109, a memory110, a packet transmit/receive section 111 for transmitting andreceiving packets between networks 103, 104 and 105, and a flow controlsection 112 which performs prohibition and rate limiting on packets. Thememory 110 includes a routing table 113 for determining the network tobe used for transferring according to destination addresses included inpackets, and a packet buffer 114 that provides temporary storage forpackets received at the packet transmit/receive section 111. Inaddition, the flow control section 112 includes a flow controlinformation memory 115 for storing rules regarding prohibition and ratelimiting to be performed on the packets.

The specific traffic detection and control section 107 is composed a CPU116 and a memory 117. The memory 117 includes a traffic informationbuffer 118 for storing traffic information sent from the packettransferring section 106, a packet count table 119 for storingstatistics on packets transferred by the packet transferring section 106from the traffic information, a threshold table 120 for storingthresholds necessary to perform determination of the statistics, and acontrol policy table 121 describing processing to be performed when thestatistics exceed the thresholds.

In the above configuration, upon receiving a packet from networks 103,104 and 105, the packet transferring section 106 generates trafficinformation regarding the packet and hands it to the specific trafficdetection and control section 107, and transmits the packet to thedestination network according to the content of the routing table 113.The specific traffic detection and control section 107 statisticallyprocesses the traffic information and detects inappropriate traffic, andif necessary, generates configuration information for performingprohibition or rate limiting on the inappropriate traffic, andaccordingly configures the flow control information memory 115 of thepacket transferring section 106.

An example of an operation of the network controller 101 will now bedescribed in detail using the flowchart shown in FIG. 5. The detaileddescription will commence with the processing at the packet transferringsection 106 when a packet 501 arrives at the packet transmit/receivesection 111 from either one of the networks 103, 104 or 105.

Packet reception commences when the packet 501 arrives at the packettransmit/receive section 111 (step 502). More specifically, the packettransmit/receive section 111 writes the content of the packet 501 intothe packet buffer 114, and notifies the CPU 109 of the arrival of packet501 by using an interrupt signal or the like. At this point, it isassumed that no rules for performing prohibition or rate limiting on thepacket 501 have been configured at the flow control information memory115.

Next, the CPU 109 generates traffic information from the content of thepacket stored in the packet buffer 114 (step 503). The trafficinformation is generated by extracting a source IP address, adestination IP address, a source port number, a destination port number,and a protocol number contained in an IP header, as well as a TCP headeror a UDP header of the packet. Elements of traffic information are notlimited to the above, and other elements may be added if necessary. Thegenerated traffic information is temporarily stored in the memory 110.

The CPU 109 then transmits the traffic information temporarily stored inthe memory 110 to the specific traffic detection and control section 107as traffic information 505 (step 504).

FIG. 6 shows an example of the content of traffic information 505. Asingle packet's worth of traffic information is composed of a source IPaddress 602, a destination IP address 603, a source port number 604, adestination port number 605 and a protocol number 606, and is configuredso that a plurality of such sets are stored. The number of storedpackets is displayed as the packet number 601.

Single packet information is not limited to the five types describedabove, and may be the values of other items included in the IP header,as well as the TCP header or the UDP header, or a portion of datasucceeding the TCP header or the UDP header.

Single packet information may also be the values of other items includedin an IP header, as well as a TCP header or a UDP header, or a portionof data succeeding the TCP header or the UDP header, of an IP packetstored in a packet of tunneling protocols such as L2TP or PPP.

Single packet information may also be information included in anEthernet (trademark) header or an MPLS label of a layer 2 packet storingan IP packet.

Alternatively, a predetermined number of bytes taken from the head of apacket may be stored as-is as the single packet information.

The traffic information 505 is arranged to be capable of storing aplurality of packet information in order to improve performance byreducing the number of data transfers from the packet transferringsection 106 to the specific traffic detection and control section 107.Any number of packet information may be stored in traffic information505.

In step 503, the retrieval of traffic information from the packets maybe performed only on packets appropriately sampled, instead of allreceived packets. This enables processing of even high-speed networkswith vast volumes of traffic.

The sampling may be performed on all packets sharing a particularcharacteristic to retrieve traffic information. The particularcharacteristic may be, for instance, packets set with SYN flags in TCPpackets. This may improve detection accuracy of targeted inappropriatetraffic in high-speed networks.

When an appropriate number of traffic information generated in step 503accumulates in the memory 110, the CPU 109 configures the informationinto traffic information 505 and transmits it to the specific trafficdetection and control section 107, and deletes the accumulated trafficinformation from the memory 110 (step 504). Examples of specifictransmission methods to the specific traffic detection and controlsection 107 include, for instance, having the CPU 109 directly writetraffic information 505 into the traffic information buffer 118 providedin the memory 117 through the connection interface 108, and notify theCPU 116 of the completion of the writing processing by an interruptsignal via the connection interface 108.

The CPU 109 then determines a destination network of the packet storedin the packet buffer 114 by referencing the routing table 113 (step506). The routing table 113 includes a description, corresponding to thepacket's destination IP address, regarding which network (in the presentexample, either one of the networks 103, 104 and 105) the packet shouldbe forwarded to, and therefore enables determination of a destinationnetwork by retrieving the destination IP address from the packet 501 andsearching the IP address from the routing table 113.

Finally, the packet stored in the packet buffer 114 is sent as a packet508 to the destination network determined in step 506 (step 507).

Meanwhile, at the specific traffic detection and control section 107,when the CPU 116 receives notification of the transfer of trafficinformation 505 in the processing of step 504, the CPU 116 performs ananalysis of traffic information 505, and upon detecting inappropriatetraffic generates a flow control configuration information 510 forperforming either prohibition or rate limiting on the traffic, andtransmits it to the packet transferring section 106 (step 509).

Upon receiving the flow control configuration information 510, the CPU109 of the packet transferring section 106 writes the content of theflow control configuration information 510 into the flow control settingmemory 115 (step 511). The flow control section 112 is now able toperform control specified in the flow control configuration information510 such as prohibition or rate limiting on the packet specified in theflow control configuration information 510. This concludes thedescription of the overall flow of the network controller 101.

Next, details of traffic information analysis performed by the specifictraffic detection and control section 107 in step 509 will be describedin further detail using the flowcharts shown in FIGS. 7, 8 and 9.

FIG. 7 is a flowchart indicating the details of operation of the CPU 116in step 509. First, the CPU 116 acquires one packet's worth of trafficinformation from the traffic information stored in the trafficinformation buffer 118 (step 701), analyzes the traffic information, andupdates the packet count table 119 (step 702).

The structure of the packet count table 119 is shown in FIG. 2. Theanalysis method used in the traffic information analysis according tothe present example extracts characteristic traffic by generating anarbitrary itemset of items composing traffic information, andaccumulating the number of packets containing the itemset. The packetcount table 119 is a table for retaining results of the accumulation. Inthe present example, it is assumed that four types of items compose thetraffic information: namely, source IP address, destination IP address,source port number and destination port number. Itemsets of any n items(where 1≦n≦4) are generated from the aforementioned four items. Thepacket count table 119 is composed of a one-item table 201 for storingthe accumulated value when n=1, a two-item table 202 for storing theaccumulated value when n=2, a three-item table 203 for storing theaccumulated value when n=3, and a four-item table 204 for storing theaccumulated value when n=4. The tables are sometimes referred to as afirst count section, a second count section, and so on.

In the present invention, while the items to be processed have beenlimited to the above four types, items may be added or deleted accordingto the characteristics of the traffic to be detected. For instance, flaginformation contained in a TCP header may be included to extract trafficrelated to establishing and terminating TCP sessions. Alternatively, thefirst given number of bytes of the application data following a TCPheader or a UDP header may be included to better understand thecharacteristics of the traffic. Alternatively, when an MPLS label isattached, the MPLS label can also be included to perform trafficanalysis per LSP. Alternatively, when using a tunneling protocol such asL2TP, tunnel identifiers may be included to perform analysis on trafficpassing through the tunnels on a per-tunnel basis.

The details of updating the packet count table 119 in step 702 will beexplained using another flowchart. FIG. 9 is a flowchart illustratingthe detailed contents of the processing of step 702.

First, the CPU 116 generates itemsets of n given items selected from theaforementioned four items (step 901). In step 901, while all itemsetsthat are mathematically obtainable may be generated, it is also possibleto generate only a limited number of itemsets for the purpose ofspeeding up processing by reducing load.

Next, one itemset is selected from those generated in step 901, and anentry in the packet count table 119 for accumulating the number ofpackets containing the selected itemset is decided (step 902). If theselected itemset consists of one item, the selection is made from theone-item table 201; if the itemset consists of two items, the selectionis made from the two-item table 202; if the itemset consists of threeitems, the selection is made from the three-item table 203; and if theitemset consists of four items, the selection is made from the four-itemtable 204. Examples of the selection algorithm include a method where anappropriate hash function is applied to the selected itemset, and theresulting hash value is divided by the number of entries to obtain ahash number.

Once the entry to be used in step 902 is determined, the current contentof the entry is verified (step 903).

If the entry is unused, the content of the selected itemset is writteninto the type and value fields of the items in the entry, and aftersetting the counter value field to 0 (step 904), 1 is added to thenumber of packets field in the entry (step 905).

On the other hand, after step 903, if the entry is already used by theselected itemset, the process jumps to step 905 to add 1 to the countervalue in the entry.

Meanwhile, after step 903, if the entry is already used by anotheritemset, 1 is subtracted from the number of packets in the entry (step906). If the result is 0, the process skips to step 904, otherwise theprocess skips to step 908 (step 907). This processing makes it easierfor the itemset appearing more frequently to remain in the packet counttable 119 when different itemsets attempt to use the same entry in thepacket count table 119.

Next, the CPU 116 verifies whether the value of the number of packetsfield in the entry exceeds a predetermined threshold (step 908). Thepredetermined threshold is stored in the threshold table 120. Thecontent of the threshold table 120 is as shown in FIG. 3. A plurality ofthresholds may be defined, and a level number referred to as a thresholdlevel may be defined for each threshold. While the example of FIG. 3indicates that five threshold levels ranging from threshold level 1 to 5have been defined, the number of possible levels is not limited to thisexample. It is assumed that the content of the threshold table 120 isconfigured in advance through the input/output device 102.

In step 908, when the value of the number of packets field equals any ofthe values defined in the threshold field of the threshold table 120,the CPU 116 determines that an overthreshold event has occurred, andgenerates overthreshold information (step 909). The content ofoverthreshold information is as shown in FIG. 8, and is composed of atable type 801 that indicates the type of table (in the present example,any of the tables ranging from the one-item table 201 to the four-itemtable 204) that contains the entry in which the overthreshold event hadoccurred, an entry number 802 that indicates the number of the entry, athreshold level 803 that corresponds to the threshold in the thresholdtable 120 when the overthreshold event occurred, as well as a source IPaddress 804, a destination IP address 805, a source port number 806, adestination port number 807 and a protocol number 808 contained in thetraffic information to be analyzed. The generated overthresholdinformation is temporarily stored in the memory 117.

The processing performed in steps 902 through 909 is repeated until allthe itemsets generated in step 901 are processed (step 910). Thisconcludes the detailed description of the operation performed in step702.

Returning to the flowchart of FIG. 7, once step 702 is concluded, theprocess verifies whether the overthreshold information generated in step907 exists in the memory 117 (step 703). If so, determination of whetherthe overthreshold information is an inappropriate traffic is performed(step 704). As inappropriate traffic, the present example is capable ofdetermining traffic caused by network worm outbreaks, and traffic causedby DDoS attacks on network computers.

The details of distinguishing problematic traffic in step 704 will nowbe explained using a different flowchart. FIG. 10 is a flowchartillustrating the detailed contents of the processing of step 704.

First, the CPU 116 verifies the content of the item type field of theentry in the packet count table 119 specified by the table type 801 andthe entry number 802 contained in the overthreshold information (step1001).

When the table type 801 indicates the two-item table, and the values ofthe type field contained in the entry are a source IP address and adestination port number, it is determined that the traffic indicated bythe overthreshold information is possibly traffic caused by a networkworm outbreak, and steps 1002 and onward are performed for verification.

Computers infected by a network worm are likely to transmit traffic forfurther spreading the worm to an unspecified number of computers, andsuch traffic are usually forwarded to a particular port number.Therefore, when a large quantity of packets sharing a certaincombination of a source IP address and a destination port number isobserved, such packets may be determined to possibly be traffic causedby a network worm outbreak.

However, in order to truly determine that the packets are possiblytraffic caused by a network worm outbreak, the contents of other entriesin the packet count table 119 must also be verified. This is because,for instance, many packets sharing a certain combination of a source IPaddress and a destination port number are also observed during normalone-to-one communications between two particular computers.

Therefore, in order to distinguish such normal traffic from trafficcaused by network worm outbreaks, a search is performed for entries ofthe three-item table 203 containing the source IP address and thedestination port number of the overthreshold information, as well as thedestination IP address in their type fields as their third item (step1002).

When such an entry is found in step 1002, and the value of the number ofpackets field is large enough to justify determination as normaltraffic, the traffic is determined to be normal traffic (step 1003). Ifnot, the traffic is determined to be traffic caused by a network wormoutbreak (step 1004).

Also, in step 1001, when the table type 801 indicates the two-itemtable, and the values of the type field contained in the entry are adestination IP address and a destination port number, it is determinedthat the traffic indicated by the overthreshold information is possiblytraffic caused by a DDoS attack, and steps 1005 and onward are performedfor verification.

Computers under DDoS attack receive communication requests at the sameport number from a multitude of computers. Therefore, when a largequantity of packets sharing a certain combination of a destination IPaddress and a destination port number is observed, such packets may bedetermined to possibly be traffic caused by a DDoS attack.

However, in order to truly determine that the packets are possiblytraffic caused by a DDoS attack, the contents of other entries in thepacket count table 119 must also be verified. This is because, forinstance, many packets sharing a certain combination of a destination IPaddress and a destination port number are also observed during normalone-to-one communications between two particular computers.

Therefore, in order to distinguish such normal traffic from trafficcaused by DDoS attacks, a search is performed for entries of thethree-item table 203 containing the destination IP address and thedestination port number of the overthreshold information, as well as thesource IP address in their type fields as their third item (step 1005).

When such an entry is found in step 1005, and the value of the number ofpackets field is large enough to justify determination as normaltraffic, the traffic is determined to be normal traffic (step 1006). Ifnot, the traffic is determined to be traffic caused by a DDoS attack(step 1007). This concludes the detailed explanation of step 704.

While the present example presents a method of determining trafficcaused by network worm outbreaks and DDoS attacks as examples ofdetectable problematic traffic, problematic traffic detectable by thepresent embodiment are not limited to the above. For instance, when aparticular computer is generating excessive traffic, it is possible toestimate the type of application (e.g. P2P file transfer) that iscausing the traffic by analyzing the packet count table 119.

Returning to the flowchart shown in FIG. 7, when it is determined instep 704 that the overthreshold information generated in step 702 isproblematic traffic (step 705), the CPU 116 searches whether a controlmethod for the problematic traffic is described in the control policytable 121 (step 706).

FIG. 4 shows a configuration of the control policy table 121. Thecontrol policy table 121 is a table that defines the contents ofcontrols such as prohibition or rate limiting by using filters for eachtraffic type including traffic caused by network worm outbreak or DDoSattacks. The control policy table 121 also allows configuration oflimiting conditions for each traffic type by using IP addresses and portnumbers, which makes it possible to define different control contentsfor different limiting conditions for the same traffic type. It isassumed that the contents of the control policy table 121 is configuredin advance through the input/output device 102.

In step 706, an entry with a traffic type matching the problematictraffic type determined in step 704 and a limiting condition matchingthe information included in the overthreshold information generated instep 702 (from threshold level 804 to protocol number 809) is searchedfrom the control policy table 121.

If an entry matching the problematic traffic is found in the controlpolicy table 121 in step 706 (step 707), the CPU 116 generates flowcontrol configuration information 510 that corresponds to the controlcontent written in the entry, and transmits the generated information tothe packet transferring section 106 (step 708). At this point, thediscovery of problematic traffic may be displayed on the input/outputdevice 102 as report information, or may be recorded into the memory117.

This concludes the analysis on the one packet's worth of trafficinformation obtained in step 701. If any outstanding traffic informationremains in the traffic information buffer 118, the steps 702 and onwardare repeated. When processing is concluded for all traffic informationfor all packets, step 509 is concluded (step 709). This hereby concludesthe detailed description of the traffic information analysis performedby the specific traffic detection and control section 107.

According to the present example, in a network controller fortransferring packets between networks, it is an advantage of the presentinvention that traffic considered to be problematic may be effectivelyextracted from the packet to be transferred even when connected to ahigh-speed network, and countermeasures such as prohibition or ratelimiting may be automatically imposed for such traffic.

2. Second Example

A second example will now be described. FIG. 11 is a configurationdiagram of a network controller according to a second example of thepresent embodiment. In the drawing, reference numeral 1101 denotes apacket transferring device for transferring packets between networks103, 104 and 105, and reference numeral 1102 denotes a networkcontroller for analyzing information received from the packettransferring device.

The packet transferring device 1101 is composed of a CPU 1103, a memory1104, a packet transmit/receive section 1105 for transmitting andreceiving packets between networks 103, 104, 105 and the networkcontroller 1102, and a flow control section 1106. The memory 1104includes a routing table 1107 for determining which network should beused for transfer according to destination addresses contained inpackets, and a packet buffer 1108 that provides temporary storage forpackets received at the packet transmit/receive section 1105. Inaddition, the flow control section 1106 includes a flow controlinformation memory 1109 for storing rules such as filtering and ratelimiting to be performed on the packets.

The network controller 1102 is composed of a CPU 1110, a memory 1111,and a packet transmit/receive section 1112 for transferring packetsbetween the packet transferring device 1101. The memory 1111 includes atraffic information buffer 1113 for storing traffic information sentfrom the packet transferring device 1101, a packet count table 1114 forstoring statistics on packets transferred by the packet transferringdevice 1101 from the traffic information, a threshold table 1115 forstoring thresholds necessary to perform determination of the statistics,and a control policy table 1116 describing processing to be performedwhen statistics exceed the thresholds.

In the above configuration, upon receiving a packet from networks 103,104 and 105, the packet transferring device 1101 generates trafficinformation regarding the packet and hands it to the network controller1102, and transfers the packet to the destination network according tothe contents of the routing table 1107. The network controller 1102statistically processes the traffic information and detectsinappropriate traffic, and if necessary, generates configurationinformation for performing filtering or rate limiting on theinappropriate traffic and transmits the configuration information to thepacket transferring device 1101, and accordingly configures the flowcontrol section 1106 of the packet transferring device 1101.

An example of a detailed operation of the network control system of FIG.11 will now be described using the flowchart shown in FIG. 12. Thedetailed description will commence with the processing at the packettransferring device 1101 when a packet 1201 arrives at the packettransmit/receive section 1105 from any of the networks 103, 104 or 105.

Packet reception commences when the packet 1201 arrives at the packettransmit/receive section 1105 (step 1202). More specifically, the packettransmit/receive section 1105 writes the content of the received packet1201 into the packet buffer 1108, and notifies the CPU 1103 of thearrival of packet 1201 using an interrupt signal or the like. At thispoint, it is assumed that no rules for performing prohibition or ratelimiting on the packet 1201 have been configured at the flow controlinformation memory 1109.

Next, the CPU 1103 generates traffic information from the content of thepacket stored in the packet buffer 1108 (step 1203). The method forgenerating traffic information is the same as step 503 of the flowchartshown in FIG. 5, and the content of the traffic information is the sameas that of the traffic information 505 shown in FIG. 6. Alternatively,the traffic information 1205 may simply be a mirroring of the packet.

The CPU 1103 then transmits the traffic information to the networkcontroller 1102 through the packet transmit/receive section 1105 astraffic information 1205 (step 1204). At this point, it is assumed thatno rules for performing prohibition or rate limiting on the trafficinformation 1205 have been configured at the flow control informationmemory 1109.

Step 1204 is the same as step 504 in the flowchart shown in FIG. 5 inthat an appropriate number of packets-worth of traffic information iscollectively transmitted to the network controller 1102.

The CPU 1103 then determines a destination network of the packet storedin the packet buffer 1108 by referencing the routing table 1107 (step1206). The content of the routing table 1107 is the same as in therouting table 113 of the first example shown in FIG. 1.

Finally, the packet stored in the packet buffer 1108 is sent as a packet1208 to the destination network determined in step 1206 (step 1207).

Meanwhile, when the traffic information 1205 is received through theprocessing of step 1204, the network controller 1102 stores the contentof traffic information 1205 received by the packet transmit/receivesection 1112 into the traffic information buffer 1113, and notifies theCPU 1110 of the reception of the traffic information 1205 using aninterrupt signal and the like (step 1209).

When the traffic information 1205 is transmitted to the CPU 1110, theCPU 1110 performs an analysis of the traffic information 1205, and wheninappropriate traffic is detected, generates flow control configurationinformation 1211 to perform prohibition or rate limiting on the traffic,and transmits the information to the packet transferring device 1101through the packet transmit/receive section 1112 (step 1210).

Upon receiving the flow control configuration information 1211, the CPU1103 of the packet transferring device 1101 writes the content of theflow control configuration information 1211 into the flow controlsetting memory 1109 (step 1212). The flow control section 1106 is nowable to perform control specified in the flow control configurationinformation 1211 such as prohibition or rate limiting on the packetspecified in the flow control configuration information 1211.

The contents of the traffic information analysis performed by thenetwork controller 1102 (step 1210) is the same as the trafficinformation analysis performed by the specific traffic detection andcontrol section 107 of the first example (step 509 in FIG. 5).Therefore, details will not be provided here. The contents of the packetcount table 1113, the threshold table 1115 and the control policy table1116 are respectively the same as those of the packet count table 119,the threshold table 120 and the control policy table 121 shown in FIG.1.

This concludes the description of the overall flow of the networkcontrol system according to the present example.

According to the present example, it is an advantage of the presentinvention that traffic considered to be problematic may be extracted athigh speed, and a network control system capable of automaticallyperforming measures such as prohibition or rate limiting on such trafficmay be achieved by merely adding a device for collecting and analyzinginformation related to transferred traffic to an existing packettransferring device capable of transmitting information related to thetraffic to the outside via a network.

3. Third Example

A third example will now be described. FIG. 13 is a diagram illustratingan alternate embodiment of the packet count table 119 of the firstexample shown in FIG. 1. The alternate embodiment is a table similar tothe packet count table 119 that generates arbitrary itemsets for itemscomposing traffic information to accumulate the number of packetscontaining the itemsets.

In the present example, it is assumed that four types of items composethe traffic information: namely, source IP address (src ip), destinationIP address (dst ip), source port number (src port) and destination portnumber (dst port). An itemset of any n items (where 1≦n≦4) is generatedfrom these four items.

In the present invention, while the items to be processed have beenlimited to the above four types, items may be added or deleted accordingto the characteristics of the traffic to be detected. For instance, flaginformation contained in a TCP header may be included to extract trafficrelated to establishing and terminating TCP sessions. Alternatively, thefirst given number of bytes of the application data following a TCPheader or a UDP header may be included to better understand thecharacteristics of the traffic. Alternatively, when an MPLS label isattached, the MPLS label can also be included to perform trafficanalysis per LSP. Alternatively, when using a tunneling protocol such asL2TP, tunnel identifiers may be included to perform analysis on trafficpassing through the tunnels on a per-tunnel basis.

In the packet count table 1300, all entries have fields of itemscomposing the traffic information regardless of the number of items inthe itemset. Fields of items composing the itemsets store the value ofthe item, while fields of other items store the number of types ofvalues appearing in the count of the number of packets having theitemset. Therefore, fields corresponding to each item have attributefields indicating whether the values stored in the field are values ofthe item or the number of appeared types.

For instance, entry number 4 of FIG. 13 represents that 20 packets witha source IP address Z, a destination IP address Y and a destination portnumber d has appeared, and that there were 8 types of source portnumbers contained in the 20 packets.

When using the packet count table 1300, the flowchart of updating thepacket count table (step 702) of FIG. 7 will be as shown in FIG. 14. Theprocessing of step 702 when using the packet count table 1300 will nowbe described with reference to FIG. 14.

The CPU 116 first performs initialization of a supplementary table 1500in step 1401.

The supplementary table 1500 is a table structured as shown in FIG. 15,and is composed of entries corresponding to each itemset. An entry iscomposed of a new appearance flag that indicates whether there arevalues newly appeared for items not contained in the itemsets, and afield for storing entry numbers of the packet count table 1300 thatcounts the number of packets for the itemsets.

The initialization of the supplementary table 1500 involves setting allvalues for the new appearance flags for all entries to 0, and enteringvalues indicating no entry numbers in the entry number fields.

Next, the CPU 116 generates itemsets of n given items selected from theaforementioned four items (step 1402). In step 1402, while all itemsetsthat are mathematically obtainable may be generated, it is also possibleto generate only a limited number of itemsets for the purpose ofspeeding up processing by reducing load.

Next, one itemset is selected from those generated in step 1402, and anentry in the packet count table 1300 for accumulating the number ofpackets containing the selected itemset is decided (step 1403). Examplesof the selection algorithm include a method where an appropriate hashfunction is applied to the selected itemset, and the remainder ofdividing the resulting hash value by the number of entries is used as anentry number.

Once the entry to be used in step 1403 is determined, the currentcontent of the entry is verified (step 1404).

If the entry is unused, for items contained in the itemset among eachitem of the entry, the values of such items are written into theirattribute fields as “values”. On the other hand, for items not containedin the itemset, 0 is written into their attribute fields as “numbers ofappeared types”. Then, the packet number field is set to 0 (step 1405).

Next, the supplementary table 1500 is updated (step 1406). Morespecifically, after removing an arbitrary item from the itemset, amongthe new appearance flags of the entries of the supplementary table 1500corresponding to the resulting itemset, the value of the fieldcorresponding to the removed item is set to 1. This processing isperformed for all itemsets obtained by removing an arbitrary item fromthe original itemsets. The processing of step 1406 functions tomemorize, for an itemset, the appearance of a new item not contained inthe itemset.

1 is then added to the packet number field of the entry selected in step1403 (step 1407), and the entry numbers of the entries of the packetcount table 1300 selected in step 1403 are stored in the entry numberfield of the entry corresponding to the itemset in the supplementarytable 1500 (step 1408).

On the other hand, after step 1404, if the entry is already used by theselected itemset, the process jumps to step 1407 to add 1 to the numberof packets in the entry. An entry already used by a selected itemsetmeans that the itemset has appeared previously. Therefore, there is noneed to update the new appearance flag of the supplementary table 1500,and the processing of step 1406 is also not required.

Meanwhile, after step 1404, if the entry is already used by anotheritemset, 1 is subtracted from the number of packets in the entry (step1409). If the result is 0, the process skips to step 1405, otherwise theprocess skips to step 1411 (step 1410). This processing makes it easierfor the itemset appearing more frequently to remain in the packet counttable 1300 when different itemsets attempt to use the same entry in thepacket count table 1300.

Next, the CPU 116 verifies whether the value of the number of packetsfield in the entry exceeds a predetermined threshold (step 1411). Thepredetermined threshold is stored in the threshold table 120.

In step 1411, when the value of the number of packets field equals anyof the values defined in the threshold field of the threshold table 120,the CPU 116 determines that an overthreshold event has occurred, andgenerates overthreshold information (step 1412). The content of theoverthreshold information of the present example is the overthresholdinformation shown in FIG. 8 with the table type 801 removed therefrom.The generated overthreshold information is temporarily stored in thememory 117.

The processing performed in steps 1403 through 1412 is repeated untilall the itemsets generated in step 1402 are processed (step 1413).

Finally, referencing the supplementary table 1500, the values of theitems with “numbers of appeared types” as the values of their attributefield in the entries of the packet count table 1300 are updated (step1414). More specifically, for each entry of the packet count table 1300that are indicated by the entry number field of each entry of thesupplementary table 1500, 1 is added to the values corresponding toentries of the supplementary table 1500 with their new appearance flagsset to 1. This is performed for all entries of the supplementary table1500.

This concludes the detailed description of the operation performed instep 702 when using the packet count table 1300.

Furthermore, when using the packet count table 1300 according to thepresent example, the flowchart of the problematic traffic determinationprocessing (step 704) shown in FIG. 7 will be replaced by the flowchartshown in FIG. 16. The processing of step 704 when using the packet counttable 1300 will now be described below using FIG. 16.

First, among the items contained in the entries of the packet counttable 1300 specified by the entry number 802 contained in theoverthreshold information, the CPU 116 verifies itemsets of items with“values” as their attribute fields (step 1601).

Among the items contained in the entries, when the itemset with a valueas its attribute field is a source IP address and a destination portnumber, it is determined that the traffic indicated by the overthresholdinformation is possibly traffic caused by a network worm outbreak, andsteps 1602 and onward are performed for verification.

Computers infected by a network worm are likely to transmit traffic forfurther spreading the worm to an unspecified number of computers, andsuch traffic are usually forwarded to a particular port number.Therefore, when a large quantity of packets sharing a certaincombination of a source IP address and a destination port number isobserved, such packets may be determined to possibly be traffic causedby a network worm outbreak.

However, for instance, many packets sharing a certain combination of asource IP address and a destination port number are also observed duringnormal one-to-one communications between two particular computers.Therefore, in order to distinguish such normal traffic from trafficcaused by network worm outbreaks, the number of appeared types of sourceIP addresses indicated in the entry is verified (step 1602).

In step 1602, when the number of appeared types is equal or close to thethreshold, this means that the traffic is a transmission of packets withidentical destination port numbers to an unspecified number ofcomputers, and is thus determined that the traffic is highly likely tobe caused by a network worm outbreak (step 1603).

Also, in step 1601, among the items contained in the entries, when theitemset with a “value” as its attribute field is a destination IPaddress and a destination port number, it is determined that the trafficindicated by the overthreshold information is possibly traffic caused bya DDoS attack, and steps 1604 and onward are performed for verification.

Computers under DDoS attack receive communication requests at the sameport number from a multitude of computers. Therefore, when a largequantity of packets sharing a certain combination of a destination IPaddress and a destination port number is observed, such packets may bedetermined to possibly be traffic caused by a DDoS attack.

However, for instance, many packets sharing a certain combination of adestination IP address and a destination port number are also observedduring normal one-to-one communications between two particularcomputers. Therefore, in order to distinguish such normal traffic fromtraffic caused by DDoS attacks, the number of appeared types of sourceIP addresses indicated in the entry is verified (step 1604).

In step 1604, when the number of appeared types is equal or close to thethreshold, this means that the traffic is a transmission of packets withidentical destination IP addresses and destination port numbers to anunspecified number of computers, and is thus determined that it is verylikely that the traffic is caused by a DDoS attack (step 1605).

This concludes the detailed description of the operation performed instep 704 when using the packet count table 1300 according to the presentexample.

According to the present example, since the number of types of appeareditems not included in the itemsets may be counted while counting thenumber of packets for each itemset, determination of problematic trafficcan be performed at higher speeds due to less CPU load. In addition, byincreasing the speed of basic processing for the determination ofproblematic traffic, high-precision determination of problematic trafficthrough the concomitant use of packet number count information of otheritemsets can be achieved at practical CPU loads and processing speeds.

For instance, when it is determined in step 704 that traffic is likelyto be caused by a DDoS attack, the concomitant use of packet numbercount information of other itemsets enables verification of whether thetraffic is really an attack or otherwise a mass of normal access from alarge number of computers is occurred. In this case, other itemsetsrepresent opposing traffic transmitted from the computer under attack.More specifically, the itemsets are a combination of the two items of adestination IP address of traffic determined to be an attack as thesource IP address, and the destination port number of traffic determinedto be an attack as the source port number, and are those with a largenumber of appeared types of destination IP addresses. After searchingthe count information for these other itemsets in the packet count table1300, if the number of packets is equal to or exceeds the number ofpackets used to determine a DDoS attack, this means that a considerablenumber of acknowledgment packets have been returned, and therefore itcan be judged that the traffic is a concentration of normal access andnot a DDoS attack.

While the above description presented a case where the packet counttable 119 in the configuration illustrated in the first example (theconfiguration of FIG. 1) is replaced with the packet count table 1300according to the present example, the same effect can be achieved byreplacing the packet count table 1114 in the configuration illustratedin the second example (FIG. 11) with the packet count table 1300according to the present example.

In addition to the examples described above, a first alternativeembodiment of the present invention is a network controller wherein theunit for accumulating the number of packets with identical values in anyone or more fieldsets of the packets obtains a region for storing theaccumulated values of the number of packets from a hash value of avalueset of fields, and when the obtained region is already used tostore accumulated values of other itemsets, the accumulated value ofsuch other itemsets is subtracted, and is used for accumulating thenumber of packets of itemsets only when the subtraction results in anaccumulated value of 0.

A second embodiment of the present invention is a network controllerthat monitors only packets sampled at a rate specified by anadministrator of the controller.

A third embodiment of the present invention is a network controller thatsamples all packets having a certain characteristic specified by anadministrator of the controller.

A fourth embodiment of the present invention is a network controllerconnected to a plurality of networks, comprising a unit for transferringpackets between the networks, and a flow control unit for controllingavailability of packet transfer or network band to be used, wherein thenetwork controller changes the configuration of the flow control unitaccording to the characteristics obtained by a packet determinationunit.

A fifth embodiment of the present invention is a network controllercomprising a flow control unit for issuing instructions on methods ofcontrolling packets under determination by a packet determination unitaccording to the characteristics obtained by the packet determinationunit.

A sixth embodiment of the present invention is a network control systemconnected to a plurality of networks, composed of a packet transmittingdevice comprising a unit for transferring packets between the networks,a unit for transmitting monitoring information of packets, a flowcontrol unit for controlling availability of packet transfer or networkband to be used, and a unit for receiving configuration information forthe flow control unit, and the aforementioned network controller,wherein the network controller receives monitoring information from thepacket transmitting device, and transmits flow control information tothe packet transmitting device.

A seventh embodiment of the present invention is a network controlmethod that monitors packets flowing through connected networks andaccumulates the number of packets with identical values in any one ormore fieldsets of the packets obtained through monitoring, and when theaccumulated number of packets exceed a specified threshold, estimatesthe characteristics of the number of packets exceeding the specifiedthreshold from the values of any one or more fieldsets that is differentfrom the abovementioned any one or more fieldsets.

It should be further understood by those skilled in the art thatalthough the foregoing description has been made on embodiments of theinvention, the invention is not limited thereto and various changes andmodifications may be made without departing from the spirit of theinvention and the scope of the appended claims.

1. A network controller for controlling a network that transmits andreceives packets, comprising: a first count section for counting firstpackets having same values for a first item group, the first item groupconsisting of a selected one or more items within a plurality of itemscontained in a flow information of packets, a second count section forcounting second packets having same values for a predetermined one ormore items in addition to the first item group of the flow information,and a specific traffic detecting section that determines abnormalitytypes based on a count by the second count section if the count by thefirst count section exceeds a threshold, wherein both of the count bythe first count section and the count by the second count section arealways incremented every time the network controller receives the secondpacket.
 2. The network controller according to claim 1, furthercomprising: a packet receiving section that receives packets from thenetwork, and a flow information acquiring section that acquires flowinformation from packets received at the packet receiving section. 3.The network controller according to claim 1, wherein: the flowinformation includes at least one item of a source IP address, adestination IP address, a source port number and a destination portnumber.
 4. The network controller according to claim 1, wherein: thespecific traffic detecting section determines whether the count ofsecond packets having same values for a second item group which includesitems of a source address, a destination port number and a destinationaddress, counted by the second count section, exceeds a predeterminedvalue if the count of first packets having the same values for the firstitem group which includes items of a source address and a destinationport number, counted by the first count section, exceeds a predeterminedvalue.
 5. The network controller according to claim 4, wherein: thespecific traffic detecting section determines that an abnormality typeof a packet is a network worm when determining that the count of secondpackets having same values for the second item group exceeds apredetermined value.
 6. The network controller according to claim 1,wherein: the specific traffic detecting section determines whether thecount of second packets having same values for a second item group whichincludes items of a destination address, a destination port number and asource address, counted by the second count section, exceeds apredetermined value, if the count of first packets having the samevalues for the first item group which includes items of a destinationaddress and a destination port number, counted by the first countsection, exceeds a predetermined value.
 7. The network controlleraccording to claim 6, wherein: the specific traffic detecting sectiondetermines that an abnormality type of a packet is a DDoS attack whendetermining that the count of second packets having the same values forthe second item group exceeds a predetermined value.
 8. The networkcontroller according to claim 1, wherein: the specific traffic detectingsection determines whether the count of second packets having a samesource address, a same destination port number and a same destinationaddress, counted by the second count section, satisfies a predeterminedcondition if the count of first packets having the same values for thefirst item group which includes items of a source address and adestination port number, counted by the first count section, exceeds apredetermined value.
 9. The network controller according to claim 8,wherein: the specific traffic detecting section determines that anabnormality type of a packet is a network worm when determining that thecount of second packets, counted by the second count section, satisfiesthe predetermined condition.
 10. The network controller according toclaim 1, wherein: the specific traffic detecting section determineswhether the count of second packets having a same destination address, asame destination port number and a same source address, counted by thesecond count section, satisfies a predetermined condition if the countof first packets having the same values for the first item group whichincludes items of a destination address and a destination port number,counted by the first count section, exceeds a predetermined value. 11.The network controller according to claim 10, wherein: the specifictraffic detecting section determines that an abnormality type of apacket is a DDoS attack when determining that the count of secondpackets, counted by the second count section, satisfies thepredetermined condition.
 12. A network controller, comprising:connecting means for connecting to one or more networks, means formonitoring packets flowing through the networks, means for accumulatinga first number of packets with same values of a first fieldset thatincludes any one or more fields of packets obtained by the monitoringmeans, and accumulating a second number of packets with same values fora second fieldset which is different from the first fieldset, and meansfor estimating the characteristics of packets with the same values of afirst fieldset based on the second number if the first number exceeds aspecified threshold, wherein the accumulating means increments both ofthe first number of packets and the second number of packets every timethe network controller receives the packet with same values for thesecond fieldset.
 13. The network controller according to claim 12,further comprising: means for accumulating a number of appearances ofvalues of fields not included in the first fieldset for packets havingthe same values of the first fieldset, wherein: the packet estimatingmeans estimates the characteristics of the packets with the same valuesof a first fieldset based on the second number and the number ofappearances accumulated by the means for accumulating numbers ofappearances.
 14. The network controller according to claim 12, wherein:the accumulating means obtains regions to store the accumulated valuesof the first and second numbers of packets from hash values of valuesets of the fields, respectively, and when the obtained regions arealready used to store accumulated value of other item sets, decrementsan accumulated value of the other item sets, and uses the obtainedregions for accumulating the first and second number of packets when thedecremented accumulated value results in
 0. 15. The network controlleraccording to claim 12, wherein: the monitoring means monitors sampledpackets.
 16. The network controller according to claim 12, furthercomprising: means connected to a plurality of networks for transferringpackets between the networks, and flow control means for controllingavailability of transfer or network band to be used for the packets,wherein: configuration of the flow control means is changed according tocharacteristics obtained by the packet estimating means.
 17. The networkcontroller according to claim 12, further comprising: means fortransferring flow control information for instructing control methodsfor packets according to characteristics obtained by the packetestimating means.
 18. A network control system comprising: the networkcontroller of claim 17, and a packet transmitting device comprising:means connected to a plurality of networks for transferring packetsbetween the networks, means for transmitting monitoring information ofthe packets, flow control means for controlling availability of transferor network band to be used for the packets, and means for receivingconfiguration information on the flow control means, wherein the networkcontroller receives the monitoring information from the packettransmitting device, and transmits the flow control information to thepacket transmitting device.